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We explain the recent numerical successes obtained by Tao Xiang's group, who developed and 
applied Tensor Renormalization Group methods for the Ising model on square and cubic lattices, 
by the fact that their new truncation method sharply singles out a surprisingly small subspace of 
dimension two. We show that in the two-state approximation, their transformation can be handled 
analytically yielding a value 0.964 for the critical exponent v much closer to the exact value 1 
than 1.338 obtained in the Migdal-Kadanoff approximation. We propose two alternative blocking 
procedures that preserve the isotropy and improve the accuracy to v = 0.987 and 0.993 respectively. 
We discuss applications to other classical lattice models, including models with fermions, and suggest 
that it could become a competitor for Monte Carlo methods suitable to calculate accurately critical 
exponents, take continuum limits and study near-conformal systems in arbitrarily large volumes. 
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The Renormalization Group (RG) ideas have triggered 
considerable conceptual and numerical progress in many 
branches of physics [U [2|. However, the basic method 
to thin down the number of degrees of freedom in con- 
figuration space 3J, often called "block spinning", has 
remained a formidable computational challenge for most 
classical lattice models (e. g., O(N) spin models and lat- 
tice gauge theories). A few years ago, inspired by the 
so-called tensor network states [H [5] introduced in the 
context of the density matrix RG method [5J [7] , a Tensor 
RG (TRG) approach of two-dimensional (2D) classical 
lattice models was proposed (Hj- Successful approxima- 
tions [8HT0] were found for the Ising model on honeycomb 
and triangular lattices. 

Very recently, the TRG method was successfully ex- 
tended to the Ising model on square and cubic lattices by 
Tao Xiang's group |llj . There are two important ingredi- 
ents in their calculations. First, their formulation allows 
an exact block spinning procedure which separates neatly 
the degrees of freedom inside the block, which are inte- 
grated over, from those kept to communicate with the 
neighboring blocks. As explained below, this provides 
a more systematic way to implement ideas initiated by 
Migdal pj] and Kadanoff [13] (abbreviated as MK here- 
after). The indices of the tensors run over some finite 
vector space of "states" associated with finite volume link 
configurations. Second, they used a new method, based 
on higher order singular value decomposition, which se- 
lects in a very economical way the most important states 
that insure the communication among the blocks. Cal- 
culations using of the order of 20 states can be carried on 
a laptop computer. The excellent agreement found with 
the Onsager solution in 2D for arbitrarily large volume 
suggests that TRG-based methods could become com- 
petitors for conventional Monte Carlo methods. 

In this Letter, we show that the truncation method of 
Ref. [IT] for the 2D Ising model sharply singles out a two- 



dimensional subspace of states. Keeping only these two 
states, we show that we can construct approximate RG 
transformations with 3 or 4 parameters, find the nontriv- 
ial fixed point and obtain precise estimates of the critical 
exponent v associated with the correlation length from 
a linear analysis. The accuracy of the estimates is sig- 
nificantly better than for textbook examples such as the 
MK approximation [I2H14] , the so-called approximate re- 
cursion formula [15 or other hierarchical approximations 

nana- 

The TRG formulation for the Ising model can be ex- 
tended to O(N) nonlinear sigma models and recent nu- 
merical implementations for 0(2) |18j indicate an opti- 
mistic outlook. It seems also possible to formulate mod- 
els with local invariance and avoid sign problems. In this 
context, it is important to understand why the method 
works so well for the Ising model. 

The paper is organized as follows. We review the basic 
TRG formulation for the Ising model on a square lat- 
tice emphasizing the connection with the MK ideas. We 
then consider the cases of an isotropic blocking (as in 
the Migdal recursion) and an anisotropic blocking (as in 
the Kadanoff version and in Ref. [H]). We also propose 
a new type of accurate isotropic projection based on a 
transfer matrix. We briefly discuss the 3D Ising model 
and how the method can be applied for lattice fermions. 
The implications for the study of near-conformal systems 
and the calculations of critical exponents are discussed in 
the conclusions. 

We consider the nearest neighbor Ising model on a 
square lattice with an inverse temperature j3. For easy 
reference, we stay close to the notations of Ref. QTj where 
it is shown that the partition function can be written as 

Z = Tr\[T% yyl . (1) 

i 

The tensor T^\ n , is attached to each site i and Tr is 



a short notation for contractions over the links joining 
nearest neighbors on the lattice. The horizontal indices 
x, x' and vertical indices y, y' take the values and 1. 
The tensor is zero for an odd number of 1. For an even 
number of 1, a factor t 1 / 2 (with t = tanh(/3)) appears 
for each 1 irrespectively of the direction. The partition 
function can be interpreted as a sum over intermediate 
states attached to the links. The reader familiar with the 
high temperature expansion of the model will recognize 
that this expression reproduces exactly the proper closed 
paths with the proper weights. 

We now use this reformulation to blockspin. First, we 
follow Migdal |T2] by using an isotropic procedure. We 
consider a square block enclosing 4 sites and sum over 
the states, inside the block, associated with the nearest 
neighbor links joining these 4 points. This defines a new 
rank 4 tensor T'xx'YY' wnere each index now takes 4 
values. 
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where X(x2, X2) is a notation for the product states. For 
reasons that will become clear later, we use the conven- 
tion: X(0, 0) = 1, X(l, 1) = 1, X(l, 0) = 3, X(0, 1) = 4. 
Later, we also use the ket notation 1 00) for X = 1 etc.. 
This is represented graphically in Fig. [T] The new tensor 
can be used to define an exact expression of the partition 
function of the same form as (JlJ, however the number 
of states proliferates as 2 2 after n steps and approxima- 
tions are needed in order to get an expression useful for 
practical purposes. 

The truncation method of Ref. [TT] relies on an 
anisotropic blocking involving two sites as shown at the 
bottom of Fig. [TJ This provides a new rank-4 tensor: 
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which can be put in a canonical form by using a Higher 
Order Singular Value Decomposition defined by a unitary 
transformation on each of the four indices (see Ref. [TT] 
for justifications and refinements). The unitary trans- 
formation for each index is the one that diagonalizes the 
symmetric tensor obtained by summing over all the other 
indices in the following way: 



GXX> - ^2 M XX"yy'M*X'X"yy' 
X"yy> 



(4) 



We now consider approximations where for each in- 
dex we only keep the two states which correspond to the 
two largest eigenvalues of Gxx'- With our convention 
on the product states, this matrix is block diagonal be- 
cause it does not connect states with even number of l's 
(X = 1, 2) to states with odd number of l's (X — 3,4). 



y 





— 1 


t 


y"\ I 




j 




V 

FIG. 1. Graphical representation of T'xx'YY 1 (t°P) an d 
M' t J , T „ , M , (bottom), the boundary of the block is 
represented by the dash lines and the product states by ovals. 



Numerically, we found that the two smallest eigenvalues 
are always very small compared to the largest one for 
any value of /? and that the second largest one is small at 
small (3 and almost as large as the largest one at large j3. 
This situation is illustrated for the initial step in Fig. [2] 
After iterations the gap sharpens as if going to smaller t 
for t < t c or larger t for t > t c . The two new states have 
the form 



|0') = cos0|OO) + sin 0| 11) 
|1') = (|10) + |01))/V2. 



(5) 



The angle cj> is obtained by diagonalizing the even-even 
block. The symmetric form of |1') is a consequence of 
G33 — G44, itself due to reflection symmetry. 

With this rather drastic projection, we obtain a new 
rank 4 tensor with indices taking again two values and 
the same parity selection rule. We divide the new tensor 
by a constant in such a way that, dropping all the primes 
herafter, Toooo = 1 ■ In the isotropic case, the reflection 
symmetry imposes that Tioio = T0110 = Tiooi = Tqiqi = 
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FIG. 2. The four eigenvalues of Gxx' at the hrst step, on a 
logarithmic scale, as a function of t = thfi. 

ti, Tiioo = Toon = ^2, Tim = ^3- For the initial tensor, 
we have what we call later the "Ising condition" : 

# = < 2 and t 3 = t\ , (6) 

but this property is not preserved by the blocking proce- 
dure which can be expressed as a mapping of the three 
dimensional parameter space {ti,t2,t$) into itself. This 
can be expressed as rational expressions involving the val- 
ues of the tensor and trigonometric functions of <p. They 
are analytical expressions and derivatives can be taken 
to calculate the linearized map. They are not written 
explicitly here but can be obtained easily with symbolic 
manipulation programs. 

A fixed point is found for j3 = 0.411594547 ... not far 
from the exact value 0.44068. . . . The fixed point is ap- 
proximately # = 0.443492, # = 0.298462, # = 0.304291 
and shows significant departure from the Ising condi- 
tion ([6|. The eigenvalues of the linearized RG trans- 
formation are A x =2.0177, A 2 =0.2022 and A 3 =0.09967. 
The scaling factor b is 2, and this implies the values 
for the critical exponents v — log bj log Ai ~ 0.987 and 
uj = — logA2/log& ~ 2.31 which can be compared with 
the exact values 1 and 2 respectively. 

For comparison, the also isotropic Migdal recursion for 
the D = 2 Ising model and 6 = 2 can be written as 

i' = 2< 2 /(l + < 4 ) (7) 

The fixed point is at t* = 0.543689 and corresponds to 
fa = 0.609378 and v = 1.338. This approximation can 
be seen as a two-state approximation which in addition 
requires the Ising condition. Improvements of MK dis- 
cussed in Ref. [2] lead to a value of v = 0.796 at first 
order in their expansion parameter and 0.93(1) at second 
order, the error bar coming from the use of different Pade 
approximants. 

This suggests that the Ising condition is too restrictive. 
It is nevertheless possible to modify the angle in Eq. 
|5]) in such a way that Ising condition remains valid. This 
is nontrivial because the Ising condition amounts to two 



equations. However, an explicit calculation shows that if 
tan <j) = 1/ tan j3 the two conditions are satisfied and the 
mapping takes the form 

t' = (l + t 2 )/2t , (8) 

which unfortunately has only the low temperature fixed 
point. 

The above results can be compared with the two-state 
truncation for the anisotropic blocking used in Ref. |llj 
where a first projection occurs after blocking pairs of ver- 
tical sites as already introduced in Eq. ^ . The complete 
transformation is then obtained by repeating the proce- 
dure with a horizontal blocking as in Kadanoff 's proposal 
|13j . We use our previous notations but with h and v 
subscripts denoting the horizontal and vertical couplings 
respectively: Tnoo = t2h and Toon = t2v We keep the 
same notations for t\ and £3 which are invariant under the 
interchange of the vertical and horizontal directions. We 
have now a map with four parameters. In the Ising con- 
dition, we need to replace ti by s/t-xxfrih- We take initial 
values that satisfy the Ising condition and are isotropic 
(tih — t2v = t = tanh(/3)). The critical value is then 
fa = 0.37945324441109. . . with a nontrivial fixed point 
for approximately #^=0.21358, #„=0.37924, ^=0.41998 
and £3= 0.27177, which is clearly anisotropic and violates 
the Ising condition. We have an additional, intermediate, 
eigenvalue which is approximately 0.657 and specific to 
the anisotropic case. This value is not very far from unity 
which is why it requires more fine-tuning of /3 to get rid 
of the irrelevant directions. The first and third eigenval- 
ues are 2.052 and 0.1934 respectively which implies v= 
0.964 and oj= 2.37. 

This anisotropic version can be compared with the 
Kadanoff recursion [13 for b —2, where first, the hori- 
zontal bonds are slided vertically with fa doubled and t v 
squared. This corresponds to doubling the vertical lat- 
tice spacing first as we did above. After repeating the 
procedure with horizontal moves, we obtain the Migdal 
recursion of Eq. Q for t v while for th we obtain 

4 = (2^/(1 + 4)) 2 , (9) 

which corresponds to reversing the order of the two op- 
erations. The fixed point is t* = 0.543689 and ti = 
(£*) 2 =0. 295598. The eigenvalue is the same in both di- 
rections and the value of v identical to the Migdal case. 

We have also considered the isotropic map with a dif- 
ferent truncation. Instead of Eq. Q, we use 

G X X' = ^2 M XX"yy M X'X"y'y> ■ ( 10 ) 
X"yy' 

The trace of this matrix is the partition function for a 
2x2 model with periodic boundary conditions. This 
gives a slightly displaced fixed point at fa = 0.3948678. 
#=0.42229, #=0.28637 and #=0.27466. The values of 
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the exponents are v = 0.993 and u> = 2.37. It should be 
noted that in this case the two small eigenvalues at criti- 
cality (0.00128 and 0.0000698) are much smaller than in 
the first calculation (0.118 and 0.0525) which may explain 
the improved accuracy on v. 

Extensions of these methods for more states, more 
components and more dimensions are in progress. For 
practical purposes, the analytical methods discussed 
above need to be implemented numerically. We have suc- 
ceeded to reproduce all the results obtained so far with 
adequate accuracy using numerical procedures which can 
be implemented using the most common programming 
languages. The fixed point can be found by monitor- 
ing successive bifurcations in tensor values. The high 
and low temperature phases are characterized by the fact 
that some tensor values go to zero (when (3 is too small) 
or one (when j3 is too large) if we iterate enough times. 
We can then fine-tune j3 and observe the stabilization of 
tensors at some nontrivial values. The eigenvalues can 
be found by taking numerical derivatives of the one step 
transformation with respect to the initial values as close 
as possible to the nontrivial fixed point. This requires 
variations small enough but not too small since we have 
only limited accuracy on /3 C1 however accurate results can 
be obtained using linear extrapolations to zero variation. 

The formulation can be extended in D dimension using 
tensors with with 2D indices. The reason the TRG block- 
ing works well in any dimension is that the links are or- 
thogonal (dual) to domain boundaries. We keep the link 
variables across the boundaries of the block fixed and 
sum unrestrictedly over all the states inside the block. 
We have extended the third method described above to 
the 3D Ising model. The block is then a cube with four 
external legs coming out of each of the six faces. The 
blocking and the projection can be built out of the loop 
made by the four edges of a face with 4 external legs 
attached to each of the 4 corners. The initial transfer 
matrix can be obtained by tracing the external legs in 
the plane of the loop with their opposite leg. We then 
obtain a 16 x 16 matrix corresponding to the 4 legs com- 
ing out of the plane of the loop in each direction. This 
matrix splits into two 8x8 blocks. Numerically, we found 
p c = 0.1996597773239 ... for a two-state projection. The 
initial eigenvalues of Gxx' at f3 c are 1.2325, 0.5082 and 
a pair with value 0.1682 which cannot be considered as 
small. For this reason, the value of v ~ 0.74 for the 2D 
Ising model in the two-states approximation is not very 
close to the accurate value 0.630(2) [19] but nevertheless 
more accurate than the MK approximation value 1.055. 

There is good empirical evidence [TTJ [TS] supporting 
the idea that as we increase the number of states in TRG 
calculations, the numerical estimates of energy and en- 
tropy get closer to values obtained by exact methods (for 
the 2D Ising model) or Monte Carlo simulations (for the 
2D 0(2) model). However, in order to reach a reasonably 
large number of states (20-30) on a laptop, one needs to 



use efficient methods. The anisotropic TRG methods 
discussed above involve less contractions or external legs 
and the computational cost for N s states can be limited 
[TTj to a Nj growth in two dimensions and a Nj 1 growth 
in three dimensions. Numerical implementations of our 
method for up to 12 states are now in progress 20 . In all 
cases, we observe a sharp split between a few large eigen- 
values, their number being characteristic of the phase, 
and the small ones as in the two states case. The in- 
teresting behavior of these new maps will be discussed 
elsewhere [2"U] . 

Because of the binary nature of Grassmann numbers, 
the techniques developed for Ising models can also be 
used for lattice models with fermions. In the case where 
we have Grassmann variables ipa with a = l,2,...,gat 
every site i and nearest neighbor interactions specified by 
a q x q matrix A^o at every link < ij >, we can write 

exp(^>A<«>#)= £ fl^MP)**"* ■ 

n<«>=o,l Q=1 

The ip are linear combinations of the ip at the same site 
obtained from the decomposition A — U AV* with U and 
V unitary and A diagonal with elements X a . The terms 
can then be factorized at every site and the local inte- 
grations performed. The states are now parametrized by 
and there are 2 q of them at every link. Trans- 
lational invariance is essential to perform large volume 
calculations. For this reason, possible gauge interations 
would need to be averaged inside the blocks. 

In summary, we have shown that two-state approxima- 
tions of the TRG capture the universal behavior of Ising 
models much better than the MK approximation. Build- 
ing on the numerical success of Ref. |llj which uses more 
states, we expect to be able to use the methods presented 
here to calculate the exponents of the 3D Ising model 
with unprecedented accuracy and study the analytical 
picture of the critical behavior provided in Ref. [3TJ [25] . 
Recent numerical results for the TRG method applied to 
the 0{2) model [TS] suggest that improvements of the 
MK approximation could be applied to abelian models 
and resolve the controversy regarding the confinement in 
4D U{X) gauge theory discussed in Ref. [53]. We are 
hoping to be able to extend the TRG method for lattice 
gauge theories with fermions. Being able to block spin 
accurately would provide an efficient tool to study the 
continuum limits of asymptotically free models and the 
conformal window of models that could provide alterna- 
tives to the fundamental Higgs mechanism |24j . 
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